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Boltzmann's principle S = k In W allows to extend equilibrium thermo-statistics 
to "Small" systems without invoking the thermodynamic limit Here we show 

that the formulation of non-equilibrium statistics and the Second Law can be easier 
formulated than by conventional theory. A deeper and more transparent under- 
standing is thus possible. The main clue is to base statistical probability on ensemble 
averaging and not on time averaging. It is argued that due to the incomplete infor- 
mation obtained by macroscopic measurements thermodynamics handles ensembles 
or finite-sized sub- manifolds in phase space and not single time-dependent trajecto- 
ries. Therefore, ensemble averages are the natural objects of statistical probabilities. 
This is the physical origin of coarse- graining which is not anymore a mathematical 
ad hoc assumption. The probabilities P(M) of macroscopic measurements M are 
given by the ratio P(M) = W(M)/W of these volumes of the sub-manifold Ai of 
the microcanonical ensemble with the constraint M to the one without. From this 
concept all equilibrium thermodynamics can be deduced quite naturally including 
the most sophisticated phenomena of phase transitions for "Small" systems. 

Boltzmann's principle is generalized to non-equilibrium Hamiltonian systems with 
possibly fractal distributions Ai in 6iV-dim. phase space by replacing the conven- 
tional Riemann integral for the volume in phase space by its corresponding box- 
counting volume. This is equal to the volume of the closure Ai. With this extension 
the Second Law is derived without invoking the thermodynamic limit. 

The irreversibility in this approach is due to the replacement of the phase-space 
volume of the fractal sub-manifold Ai by the volume of its closure Ai. The physical 
reason for this replacement is that macroscopic measurements cannot distinguish 
Ai from Ai. Whereas the former is not changing in time due to Liouville's theorem, 
the volume of the closure can be larger. In contrast to conventional coarse graining 
the box-counting volume is defined in the limit of infinite resolution. I.e. there is 
no artificial loss of information. 

PACS numbers: 05.20.Gg,05.70Ln 



I. INTRODUCTION 



Recently the interest in the thermo-statistical behaviour of non-extensive many-body systems, 
like atomic nuclei, atomic clusters, soft-matter, biological systems — and also self-gravitating astro- 
physical systems lead to consider thermo-statistics without using the thermodynamic limit. This 
is most safely done by going back to Boltzmann. 

Einstein calls Boltzmann's definition of entropy as e.g. written on his famous epitaph 



S=k-lnW 



(1) 



as Boltzmann's principle Q from which Boltzmann was able to deduce thermodynamics. Here W 
is the number of micro-states at given energy E of the TV-body system in the spatial volume V: 



W(E,N, V) = tr[eo6(E - H_ 



N) 



tr[S(E - H N )} = I — 



1 / d 3 q d 3 p 



{qCV} 



N 



8{E - H N ), 



(2) 
(3) 



eo is a suitable energy constant to make W dimcnsionless, Hn is the TV-particle Hamilton-function 
and the N positions q are restricted to the volume V, whereas the momenta p are unresticted. In 
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what follows, we remain on the level of classical mechanics. The only reminders of the underlying 
quantum mechanics are the measure of the phase space in units of 2irh and the factor 1/A! which 
respects the indistinguishability of the particles (Gibbs paradoxon). In contrast to Boltzmann [p|j6| 
who used the principle only for dilute gases and to Schrodinger Q , who thought equation (|l|) is 
useless otherwise, I take the principle as the fundamental, generic definition of entropy. In a recent 
book 0] cf. also (2^ I demonstrated that this definition of thermo-statistics works well especially 
also at higher densities and at phase transitions without invoking the thermodynamic limit. 

Before we proceed we must comment on Einstein's attitude to the principle Originally 
Boltzmann called W the "Wahrscheinlichkcit" (probability), i.e. the relative time a system spends 
(along a time-dependent path) in a given region of 6A-dim. phase space. Our interpretation of 
W to be the number of "complexions" (Boltzmann's second interpretation) or quantum states 
(trace) with the same energy was criticized by Einstein Q as artificial. It is exactly that criticized 
interpretation of W which I use here and which works so excellently (!]] . In section III I will come 
back to this fundamental point. 

After succeeding to deduce equilibrium statistics including all phenomena of phase transitions 
from Boltzmann's principle even for "Small" systems, i.e. non-extensive many-body systems, it is 
challenging to explore how far this "most conservative and restrictive way to thermodynamics" (9| 
is able to describe also the approach of (eventially "Small" ) systems to equilibrium and the Second 
Law of Thermodynamics. 

Thermodynamics describes the development of macroscopic features of many-body systems with- 
out specifying them microscopically in all details. Before we address the Second Law, we have to 
clarify what we mean with the label "macroscopic observable" . 



II. MEASURING A MACROSCOPIC OBSERVABLE, THE " EPS-FORMULATION " 

A single point {%(£), Pi(t)}i=i... at in the A-body phase space corresponds to a detailed speci- 
fication of the system with all degrees of freedom (d.o.f) completely fixed at time t (microscopic 
determination). Fixing only the total energy E of an A-body system leaves the other (6 A — 1)- 
degrees of freedom unspecified. A second system with the same energy is most likely not in the 
same microscopic state as the first, it will be at another point in phase space, the other d.o.f. will 
be different. I.e. the measurement of the total energy Hn, or any other macroscopic observable 
M, determines a (6A — l)-dimensional sub-manifold £ or A4 in phase space. All points in A-body 
phase space consistent with the given value of E and volume V, i.e. all points in the (6A — 1)- 
dimensional sub-manifold £(A, V) of phase space are equally consistent with this measurement. 
£(N, V) is the microcanonical ensemble. This example tells us that any macroscopic measurement 
is incomplete and defines a sub-manifold of points in phase space not a single point. An additional 
measurement of another macroscopic quantity B{q,p} reduces £ further to the cross-section £ n B, 
a (6A — 2)-dimensional subset of points in £ with the volume: 

W(B,E,N,V) = ±-J (|^|f) co5(E-H N { q ,p})5(B-B{q :P }) (4) 

If Hj\f{q,p} as also B{q,p\ are continuous differentiable functions of their arguments, what we 
assume in the following, £ n B is closed. In the following we use W for the Riemann or Liouville 
volume of a many- fold. 

Microcanonical thermostatics gives the probability P(B, E, N, V) to find the A-body system in 
the sub-manifold £ n B(E, A, V): 

P(R E N V) = W ( B > E > N ' ^ - Jn[W{B,E,N,V)]-S{E,N,V) (r) 

r^,*,*^) W (E,N,V) [) 

This is what Krylov seems to have had in mind |Tc| ] and what I will call the "ensemble probabilistic 
formulation of statistical mechanics (EPS) " . 

Similarly thermodynamics describes the development of some macroscopic observable B{q tl pt} 
in time of a system which was specified at an earlier time to by another macroscopic measurement 
A{q ,po}. It is related to the volume of the sub-manifold M(t) = A(t ) n B(t) n £: 
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W(A, B,E,t) = ^ J ( ^Sr ) S(B - BUuPt}) 8(A - i{g ,Po}) e S(E - H{q uPt }), (6) 

where {qt{qoi Po} j Pt{lo, Po}} is the set of trajectories solving the Hamilton-Jacobi equations 

dH dH . „ 

1i = ^— , Pi = --5—) J = l---iV (7) 

with the initial conditions {g(i = to) = Qo'- p(t = to) = Po}- For a very large system with N ~ 10 23 
the probability to find a given value B(T), P(B(t)), is usually sharply peaked as function of B. 
Ordinary thermodynamics treats systems in the thermodynamic limit N — ► 00 and gives only 
<B(t)>. However, here we are interested to formulate the Second Law for "Small" systems 
i.e. we are interested in the whole distribution P(B(t)) not only in its mean value <B(t)>. 
Thermodynamics does not describe the temporal development of a single system (single point in 
the 6iV-dim phase space). 

There is an important property of macroscopic measurements: Whereas the macroscopic con- 
straint A{go,Po} determines (usually) a compact region A(to) in {qo,po} this does not need to be 
the case at later times t 3> t : A(t) defined by A{qo{qt,Pt},Po{Qt,Pt}} might become a fractal i.e. 
"spaghetti- like" manifold as a function of {qt,Pt} in £ at i — > 00 and loose compactness. 

This can be expressed in mathematical terms: There exist series of points {a n } G A(t) which 
converge to a point aoo which is not in A(t). E.g. such points may have intruded from 
the phase space complimentary to A(to). Illustrative examples for this evolution of an initially 
compact sub-manifold into a fractal set are the baker transformation discussed in this context by 
ref. |ll] , p^| . Then no macroscopic (incomplete) measurement at time t can resolve from its 
immediate neighbors a n in phase space with distances \a n — a^l less then any arbitrary small S. In 
other words, at the time t 3> to no macroscopic measurement with its incomplete information about 
{qt,Pt} can decide whether {qo{qt, Pt} , Po{ut, Pt}} S A(to) or not. I.e. any macroscopic theory like 
thermodynamics can only deal with the closure of A(t). If necessary, the sub-manifold A(t) must 
be artificially closed to A(t) as developed further in section |Tv| . Clearly, in this approach this is 



the physical origin of irreversibility. We come back to this in section IV 



III. ON EINSTEIN'S OBJECTIONS AGAINST THE EPS-PROBABILITY 

According to Abraham Pais: "Subtle is the Lord" ||], Einstein was critical with regard to the 
definition of relative probabilities by eqj|, Boltzmann's counting of "complexions" . He considered 
it as artificial and not corresponding to the immediate picture of probability used in the actual 
problem: "The word probability is used in a sense that does not conform to its definition as given 
in the theory of probability. In particular, cases of equal probability are often hypothetically 
defined in instances where the theoretical pictures used are sufficiently definite to give a deduction 
rather than a hypothetical assertion" Q|. He preferred to define probability by the relative time 
a system (a trajectory of a single point moving with time in the iV-body phase space) spends in 
a subset of the phase space. However, is this really the immediate picture of probability used in 
statistical mechanics? This definition demands the ergodicity of the trajectory in phase space. 
As we discussed above, thermodynamics as any other macroscopic theory handles incomplete, 
macroscopic informations of the A^-body system. It handles, consequently, the temporal evolution 
of finite sized sub-manifolds - ensembles - not single points in phase space. The typical outcomes 
of macroscopic measurements are calculated. Nobody waits in a macroscopic measurement, e.g. 
of the temperature, long enough that an atom can cross the whole system. 

In this respect, I think the EPS version of statistical mechanics is closer to the experimental 
situation than the duration-time of a single trajectory. Moreover, in an experiment on a small 
system like a nucleus, the excited nucleus, which then may fragment statistically later on, is 
produced by a multiple repetition of scattering events and statistical averages are taken. No 
ergodic covering of the whole phase space by a single trajectory in time is demanded. At the 
high excitations of the nuclei in the fragmentation region their life-time would bo too short for 
that. This is analogous to the statistics of a falling ball on a Galton's nail-board where also a 
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single trajectory is not touching all nails but is random. Only after many repetitions the smooth 
binomial distribution is established. As I am discussing here the Second Law in finite systems, this 
is the correct scenario, not the time average over a single ergodic trajectory. 



IV. FRACTAL DISTRIBUTIONS IN PHASE SPACE, SECOND LAW 



Here we will first describe a simple working-scheme (i.e. a sufficient method) which allows to 
deduce mathematically the Second Law. Later, we will show how this method is necessarily implied 
by the reduced information obtainable by macroscopic measurements. 

Let us examine the following Gedanken experiment: Suppose the probability to find our system 
at points {qt : pt}\ in phase space is uniformly distributed for times t < to over the sub-manifold 
£(N, Vi) of the iV-body phase space at energy E and spatial volume V\. At time t > to we allow 
the system to spread over the larger volume V% > Vi without changing its energy. If the system 
is dynamically mixing, the majority of trajectories {qt,Pt}\ in phase space starting from points 
{qoiPo} with qo C Vi at to will now spread over the larger volume Vi- Of course the Liouvillean 
measure of the distribution A4{qt,pt} in phase space at t > to will remain the same (= tr[£{N, V\)]) 
|p3| . (The label {go C Vi} of the integral means that the positions {qo}\ are restricted to the 
volume Vi, the momenta {po}\ are unrestricted.) 



tr[M{q t {qo,Po},Pt{qo,Po}}]\ {qoCVl} = 



1 / d 3 q t d 3 p t 



{goWtKVx} ^ ! V (27rft) 



JV 



e Q S(E - H N {q t ,p t }) 



1 / d 3 q d 3 p 



{qoCVi} Nl V (27,71) 



because of: = 1. 

o{qo,po\ 



e S{E - H N {qo,p }), (8) 

(9) 



But as already argued by Gibbs the distribution A4{q t ,Pt} will be filamcntcd like ink in water and 
will approach any point of £(N, V2) arbitrarily close. M.{qt,Pt) becomes dense in the new, larger 
£{N, V2) for times sufficiently larger than to- The closure M. becomes equal to £(N, V2). This is 
clearly expressed by Lebowitz [|Lf] , p^| . 

In order to express this fact mathematically, we have to redefine Boltzmanris definition of entropy 
eq. (Qj and introduce the following fractal "measure" for integrals like (j^) or (Qj: 



W{E,N,t->to) = — 



N[ •/{?o{9 t ,Pt}CV 1 } V ( 2lTh ) 



d 3 q t d 3 p t 



TV 



e S(E - H N {q t ,p t }) 



With the transformation: 



(d 3 q t d 3 p t ) 



N 



dai 



■ da, 



do- 6N := 



IV-ETI 



W(E,N,f>t ) = 




T 6N ■ ■ 






( dH 


dq t 4 


dH 


\dq t 


-x— < 

OPi 


■)"• 


E 


' 'dH 

(, dp t 



\VH\ 



-dE 



vi(2^)wy te{gt , Mc . 1} df7i --- df76jv - i wii 



we replace M. by its closure M. and define now: 

W(E,N,t »t ) -» M(E,N,t>to) :=<G(£{N,V 2 ))> *vol box [M{E, N,t > t )], 



(10) 

(11) 
(12) 

(13) 
(14) 

(15) 



where < G(£(N, V2)) > is the average of 



over the (larger) manifold £(N, V%), and 



N<(2irh)3 N \\VH\\ 

volbox[M-(E, N, t 3> to)] is the box-counting volume of M(E,N,t ^> to) which the same as the 
volume of M, sec below. 
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To obtain vo\b ox [-M(E,N,t ;» to)] we cover the d-dim. sub-manifold M(t), here with d = 
(6N — 1), of the phase space by a grid with spacing 5 and count the number N$ oc 5~ d of boxes of 
size S 6N , which contain points of Ai. Then we determine 



vol te [M (E, N, t » to)] := Me^Ng [M (E, N, t » to)] 

with lim * = infflim*] or symbolically 
1 ( d 3 q t d 3 p t s A 



M(E,N,t^>t ) =:B d 



1 /" /d 3 g t d 3 p t 



e 5(E - H 



Nl J {qt cv 2} V (2^)3 
W(£?,JV,V 2 ) > W(E, N, Vi), 



e 6(E - H N {q t ,p t }) 



(16) 
(17) 

(18) 



where ^ means that this integral should be evaluated via the box-counting volume (|16|) here with 

d = 6iV-l. 

This is illustrated by the following figure 



V a 



V a + V b 




1 < *o t> t Q 

FIG. 1. The compact set M(to), left side, develops into an increasingly folded "spaghetti" -like distri- 
bution in phase-space with rising time t. This figure shows only the early form of the distribution. At 
much larger times it will become more and more fractal and finally dense in the new phase space. The 
grid illustrates the boxes of the box-counting method. All boxes which overlap with M(t) are counted in 
N s in eq.pl) 



With this extension of eq.(||) Boltzmann's entropy (|T|) is at time t 3> t equal to the logarithm 
of the larger phase space W(E, N, V^)- This is the Second Law of Thermodynamics. The box- 
counting is also used in the definition of the Kolmogorov entropy, the average rate of entropy gain 
0.0. Of course still at t M{t ) = M(t ) = £(N, Vi): 



M(E,N,t ) 



{■JoCVi} 



J_ / d 3 q Q d 3 p 
Nl \ {2irk) 3 

J_ / d 3 q d 3 p 
{qa cv l} Nl { (2^)3 
W(E,N,Vi). 



N 



e Q 6(E - H 



N 



N 



e S(E - H N ) 



(19) 



(20) 



The box-counting volume is analogous to the standard method to determine the fractal dimension 
of a set of points Jl(| by the box-counting dimension: 
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dim box [M(E,N,t > t Q )} := lim^ 



\nN 5 [M(E,N,t^>t )} 
1 -In J 



(21) 



Like the box-counting dimension, volb ox has the peculiarity that it is equal to the volume of 
the smallest closed covering set. E.g.: The box-counting volume of the set of rational numbers 
{Q} between and 1, is vol box {Q} = 1, and thus equal to the measure of the real numbers , 
c.f. Falconer |l6f| section 3.1. This is the reason why volbox is not a measure in its mathematical 
definition because then we should have 



vol. 



box 



E (^) 



'C{Q} 



E 

*C{Q} 



vol box [Mi] = 0, 



(22) 



therefore the quotation marks for the box-counting "measure" . 

Coming back to the the end of section ([0]), the volume W(A, B,- ■ ■ ,t) of the relevant ensemble, 
the closure M. (t) must be "measured" by something like the box-counting "measure" (0,0) with 



the box-counting integral which must replace the integral in eq.(|3j). Due to the fact that the 

box-counting volume is equal to the volume of the smallest closed covering set, the new, extended, 
definition of the phase-space integral eq.(17) is for compact sets like the equilibrium distribution 
£ identical to the old one eq.(^) and nothing changes for equilibrium statistics. Therefore, one 
can simply replace the old Boltzmann-definition of the number of complexions and with it of the 
entropy by the new one (|l7|). 



V. CONCLUSION 

Macroscopic measurements M determine only a very few of all 67V d.o.f. Any macroscopic 
theory like thermodynamics deals with the volumes M of the corresponding closed sub-manifolds 
M. in the 6iV-dim. phase space not with single points. The averaging over ensembles or finite 
sub-manifolds in phase space becomes especially important for the microcanonical ensemble of a 
finite system. 

Because of this necessarily coarsed information, macroscopic measurements, and with it also 
macroscopic theories are unable to distinguish fractal sets M. from their closures M.. Therefore, I 
make the conjecture: the proper manifolds determined by a macroscopic theory like thermodynam- 
ics are the closed AL However, an initially closed subset of points at time to does not necessarily 
evolve again into a closed subset at t ^> to. I.e. the closure operation and the t — > oo limit do not 
commute, and the macroscopic dynamics becomes irreversible. 

Here is the origin of the misunderstanding by the famous reversibility paradoxes which were 
invented by Loschmidt fq] and Zermelo [ ^9|j20| and which bothered Boltzmann so much pl| , p2| . 
These paradoxes address to trajectories of single points in the iV-body phase space which must 
return after Poincarre's recurrence time or which must run backwards if all momenta are exactly 
reversed. Therefore, Loschmidt and Zermelo concluded that the entropy should decrease as well 
as it was increasing before. The specification of a single point demands of course a microscopic 
exact specification of all 6N degrees of freedom not a determination of a few macroscopic degrees 
of freedom only. No entropy is defined for a single point. 

This way various non-trivial limiting processes can be avoided. Neither does one invoke the 
thermodynamic limit of a homogeneous system with infinitely many particles nor does one rely 
on the ergodic hypothesis of the equivalence of (very long) time averages and ensemble averages. 
The use of ensemble averages is justified directly by the very nature of macroscopic (incomplete) 
measurements. Coarse-graining appears as natural consequence of this. The box-counting method 
mirrors the averaging over the overwhelming number of non-determined degrees of freedom. Of 
course, a fully consistent theory must use this averaging explicitly. Then one would not depend 
on the order of the limits lim d -^ limj^K, as it was tacitly assumed here. Presumably, the rise 
of the entropy can then be already seen at finite times when the fractality of the distribution 
in phase space is not yet fully developed. The coarse-graining is no more any mathematical ad 
hoc assumption. Moreover the Second Law is in the EPS-formulation of statistical mechanics not 
linked to the thermodynamic limit as was thought up to now ELla]. 
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